Best Principal Submatrix Selection for the Maximum Entropy Sampling Problem: Scalable Algorithms and Performance Guarantees
نویسندگان
چکیده
This paper studies a classic maximum entropy sampling problem (MESP), which aims to select the most informative principal submatrix of prespecified size from covariance matrix. MESP is widely applied many areas, including healthcare, power systems, manufacturing, and data science. By investigating its Lagrangian dual primal characterization, we derive novel convex integer program for show that continuous relaxation yields near-optimal solution. The results motivate us study efficient approximation algorithms develop their bounds MESP, improves best known one in literature.
منابع مشابه
Entropy-based algorithms for best basis selection
Adapted waveform analysis uses a library of orthonormal bases and an efficiency functional to match a basis to a given signal or family of signals. It permits efficient compression of a variety of signals such as sound and images. The predefined libraries of modulated waveforms include orthogonal wavelet-packets, and localized trigonometric functions, have reasonably well controlled time-freque...
متن کاملPerformance Guarantees for Regularized Maximum Entropy Density Estimation
We consider the problem of estimating an unknown probability distribution from samples using the principle of maximum entropy (maxent). To alleviate overfitting with a very large number of features, we propose applying the maxent principle with relaxed constraints on the expectations of the features. By convex duality, this turns out to be equivalent to finding the Gibbs distribution minimizing...
متن کاملEntropy { Based Algorithms for Best Basis Selection 13
For voice signals and images this procedure leads to remarkable compression algorithms; see the references W2] and W3] below. The best basis method may be applied to ensembles of vectors, more like classical Karrhunen-Lo eve analysis. The so-called \energy compaction function" may be used as an information cost to compute the joint best basis over a set of random vectors. The idea is to concent...
متن کاملMaximum Entropy Sampling
Information " Chance and chance alone has a message for us. Everything that occurs out of necessity, everything expected, repeated day in and day out, is mute. Only chance can speak to us. We read its message much as gypsies read the images made by coffee grounds at the bottom of a cup. "-Milan Kundera (The Unbearable Lightness of Being) Entropy " I propose to name the magnitude S the entropy o...
متن کاملMaximum-entropy remote sampling
We consider the “remote-sampling” problem of choosing a subset S, with |S|= s, from a set N of observable random variables, so as to obtain as much information as possible about a set T of target random variables which are not directly observable. Our criterion is that of minimizing the entropy of T conditioned on S. We con ne our attention to the case in which the random variables have a joint...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Operations Research
سال: 2023
ISSN: ['1526-5463', '0030-364X']
DOI: https://doi.org/10.1287/opre.2023.2488